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@ Movement detection device and focus detection apparatus using such device. 

@ A movement detectton device for compensating for movement of an image by detecting the 
nDOvement of the Image comprises movement detection means (7) for detecting the movement of the 
image, a con-ection device (8) for correcting the movement of the image based on an output of the 
detectkMi means, and a filter (10) for perfomiing a filtering processing which compensates for 
degradation of resolutkin due to the movement of the image. And a focus detectton apparatus detects a 
focus by extracting a s^nal ODmponent varying with a focusing state from an image pick-up signal 
which has a nKsvenoent component of an image corrected by the movement correction device. 
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BACKGROUND OF THE INVENTION 
Reld of the Invention 

5 The present invention relates to a movement detection device su itable for use with a vibration-proof device 

for compensating for the movement of image being picked-up by the camera due to trembling of hand or other 
vibrations, an automatic tracking apparatus for tracking a moving object, and an automatic focus detection 
apparatus for detecting the focusing state from a pick-up signal. 

fo Related Background Art 

Recently, image instruments such as a video camera or electronic canteia have been remarkably 
developed in which to enable a more reliable and appropriate photographing operation, a nK>vement conrection 
device has been adopted, which allows the photographing of higher quality image without fluctuation by cor- 
1$ recb'ng the nK>vement of image due to trembling of hand or other vibrations. 

The movement correction method for the movement correction device involves a mechanical coirection 
method of using the inertia maintaining the axes of lens and image sensor fixed for the rotation of camera body, 
an optical correction method of using the optical member such as a vai1at>le apex angle prism, and an image 
processing conrection method for making the conrection by moving a screen with the image processing. 
20 According to the mechanical correction method, a special stmcture for supporting the lens and a pick-up 

system is required, and according to the optical conrection method, a special optical mmber such as van'able 
apex prism as described is required, while in the image processing correction method, no special mechanical 
structure and optical members are necessary, in which It has a feature of enatdlng the movement conrection 
only with the signal processing in the electrical cirojit, and is expected to be widely used in the future. 
25 However, the movement correctton device with the above-mentioned conventional Image processing 
method has a following disadvantage, compared witii the mechanical or optical device. 

That is, in performing the movement correction with the image processing method, an image has some 
movement at the pick-up stage with an image sensor or pick-up tut>e, whereby in tiie post-processing, the move- 
ment of image within a screen is removed by shifting the image in accordance with the amount of image move- 
so men! 

Thus, as the image obtained in the pick-up stage yields some unfocused portion, final resolution of image 
is tow even if the movement of image is corrected in the post-processing, so that a poor quality of image is 
given. 

Recentiy, in video instruments such as a video camera or electronic camera, an automatic focusing adjust- 
35 ment apparatus for adjusting the focus by detecting the focusing state from a pick-up signal has been adopted, 
but as above described, the movement of image may reduce a high frequency component varied with the fo- 
cusing state from the pick-up signal, thereby decreasing the sharpness, and degrading the performance of auto- 
nnatic focusing adjustment apparatus, whereby there is a risk of malfunction and so it ts quite important to detect 
and correct the movement of image in the processing using the pick-up signal. 

40 

SUMMRY OF THE INVENTION 

The present invention is intended to resolve tiie at>ove problems, and it is a first object to provide a move- 
ment detection devlce'which can compensate for the degradation of resolution due to the movement of Image. 
45 A second object of the present invention is to provide a movement detection device capable of providing 

an Image without fluctuation or deflection and having high resolution, with the movement corrected, in which 
it can compensate for the degradation of resolution with the movement of image by means of the filtering. 

A third object of the present invention is to provide a movement detection device capable of providing a 
high quality image with tta movement corrected by performing thefiltering adaptlvely by the use of the movement 
60 vector of image obtained from a movement annount detection device especially useful for the conrection of move- 
ment 

A fourth object of the present Invention is to provide a movement detection device having an effect of pro- 
viding a high quality image by compensating for the degradation of image quality resulting from tiie movement 
of image by means of the filtering, and increasing the resolution of output image for a movement correction 
55 device. 

A fifth object of the present invention is to provide a movement detection device with which the quality of 
image can be made excellent, almost optimal, without increase of the cost, by changing adaptively the charac- 
teristics of filter used in the filtering processing, particularly bas d on a movement vector to be obtained for the 
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comecb'on of movement 

To achieve such objects, a preferred embodiment of the present invention discloses a movement detection 
device for detecting the movement of an image and compensating for the movement of the Image* comprising 
movement detection means for detecting a movement of an image, conrection m ans for correcting the move- 
5 ment of the image based on an output of said detection means, and filter means for perfomning a filtering pro- 
cessing compensating for degradation of resolution with the movement of the vnage. 

A sixth object of the present invention is to provide a focus detection apparatus capable of making a high 
precision focus detection while avoiding the decrease of accuracy due to the movement of image, wherein the 
nxivement of knage is detected and the focus detection is made using a signal for which the degradation of 
10 resolution with the movement of the image has been compensated. 

A seventh object of the present invention is to provide a stable focus detection apparatus with high precision 
at all times, in which it is not subject to the influence of camera vibration or object movement because it is pose- 
&>le to prevent the degradation of accuracy In focus detection means caused by a signal decreasing in accord- 
ance with the focusing state, such as uncleamess of edge portion or decrease of the high frequency component 
15 owing to the movement of the image. 

To accomplish such objects, a prefenred embodiment of the present invention discloses a focus detection 
apparatus fordetecting afocusing state based on a pick-up signal outputfrom pick-up means, comprising move- 
ment detection nieans for detecting a movement of an image from the pick-up signal, movement correction 
means for connecting the nxyvement of the image based on an output of the movement detection means, and 
20 focus detection means for perfonming focus detectk>n by extracting a signal component vaiying with the fbcus- 
^g state from the pick-up signal having its movement component of image con'ected by the movement correc- 
tion means. 

Additional objects and feature of the present invention will become apparent from the following description 
and the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig, 1 is a block diagram showing a first example of a movement detection devtoe according to the present 
bivention. 

30 Fig. 2 is a view showing the movement of image. 

Fig. 3 is a view showing the movement of optical Image. 

Figs. 4A to 4C are characteristic views showing the filter characteristic for filtering. 
Fig. 5 Is a characteristic view showing the inverse filter characteristic. 
Fig. 6 is a characteristic view showing the Wiener filter characteristic. 
35 F^. 7 is a block diagram showing a second example of the present invention. 

Fig. 8 is a view showing otiages containing a plurality of nravements. 
Fig. 9 is a view showing area decision results. 

Fig. 1 0 is a block diagram showing a third example of a movement correction device according to the pre- 
sent invention. 

40 FJg. 11 is a view showing the niovement of image. 

Fig. 12 is a view showing the movement of optical system. 

Ffe. 13 is a view showing a point in^ge distribution function with the movement of inrtage. 
Fig. 14 is a view showing the correction of edge width. 
Fig. 15 is a block diagram showing a fourth example of the present invention. 
45 Figs. 16A and 16B are schematic graphs showing a focus detection method with a conventional Image prt>- 

oessing. 

DETAIl-ED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

SO An embodiment of a movement correction device according to the present invention w*ll be descnt>ed In 

detaO with reference to the drawings. 

Fig. 1 is a block diagram showing a first embodiment of nK>vement correction device according to the pre- 
sent irtvention. 

In tills figure, 1 is an object. 2 Is a pick-up lens, and 3 is a pick-up element or pick-up tube such as CCD 
63 for outputting a pick-up signal by photoelectrically converting an object image formed on a pick-up plane by 
the pick-up lens 2. 4 is an amplifier for amplifying th pick-up signal output from the pick-up element 3 to a pre- 
determined levelp 5 is an A/D converter for converting the input analog pick-up signal to the digital signal, 6 Is 
a frame memory for storing the image signal converted into the digital signal by the A/D conv rter 5, and 7 is 
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a movement amount detection circuit for obtaining a movement vector from tiie image signal which has been 
oonvertBd from analog to digital form. Exemplary of a method of calculating the movement vector Is that as 
used in a so-called rapresentativ point matching method or gradient method. 8 is a m mory readirig drcuit 
for reading an Image signal from the frame memory 6 by generating a read address and executing th reading. 
5 9isaparametersettingcircuitfbrsetfa*ng parametersfor prevention of image degradation, and lOisafSter. 

1 1 1s a D/A converterfor converting the digital image signal passing through the filter 1 0 to the analog image 
signal, 12 Is a synchronism signal adding circuit for adding a synchronism signal to the image signal, and 13 
Is an output video signal. 

The pick-up lens 2 forms an image of object 1 on the pick-up plane of pick-up element 3. The image on 
io the pick-up element 3 involves the movement owing to the movement of the lens 2, pick-up element 3 or object 
1. The image signal output from the pick-up element 3 is amplified by the amplifier 4, converted to the digital 
signal by the A/D converter 5, and then stored in the frame nriemory 6 temporarily. 

The digital image signal which is an output of A/D converter 5 Is also transferred to the movement aniount 
detection circutt 7. Movement vector data obtained by the movement amount detection drcuit 7 are transfenred 
16 to the memory reading drcuit 8 and the parameter setting drcuit 9. 

The movement detection circuit 7 requires data of screen one frame or field before the current screen for 
calculating the amount of movement, thereby requiring a frame memory. This frame memory may be construc- 
ted In common with the frame memory 6, or separately provided. 

The memory reading circuit 8 creates the address for reading the frame memory 8 multiplied by the offset 
20 based on movement vector data. Thereby, data read from the frame memory 6 are read out in such a way so 
as to move data almost reversely to the movement of image, so that the movement of image can t>e corrected. 
That is, the ccvrection of Image deflection can be achieved on the memory. 

The parameter setting drcuit 9 detennines parameters such as filter coeffidents based on the movement 
vector obtained from the movemertt amount detection circuit 7, and sends them to the filter 10. The filter 10 
25 filters the image s^nal having corrected movement read from the frame memory 6, so as to reduce the unfo- 
cused part resulting from the movement of nrtage on the pick-up element 3, i.e., the degradation of resolution. 

Also, the filter 10 has the characteristics of a high-pass fSter and a band-pass filter as will be described 
later. 

The image signal output from the filter 10 is converted to the analog signal by the D/A converter 11, syn- 
30 thesized with a synchronism signal by the synchronism signal addlrrg circuit 12, and output as the video signal 
13. 

The improvement of resolution with the filtering will be described In the following. 
Fig. 2 is a plan view showing the movement of image. 

21 is an output screen. The output screen 21 has a fixed coordinate system which is useful for the reference 
35 to perform the processing such as the vibration isolation. Here, a monitor display screen can be assumed, for 

example. 

22 Is a previous image, and 23 is a current image. 24 Is a movement vector when the previous image 22 
moves to the current image 23. 

In the output screen 21, a video signal 13 of Fig. 1 is displayed. For example, an image displayed with 

40 trembling of hand shows the movement from previous image 22 to cun-ent image 23 if time has passed from 
one dock to another when the object 1 is stationary. 

With the movement correction method in the image processing, the movement correction is performed In 
such a manner that the movement vector 24 is calculated in the movement amount detection drcuit 7, data is 
shifted by the amount of movement vector 24 on the output screen 21 when data of current image 23 is read 

45 firom the frame memory 6, and the oflset is added to the read address so that current image 23 can be superim- 
posed airriost on prevtous image 22. 

As current image 23 involves the movement, the value of each pixel is integrated in a direction of movement 
vector 24. Accordingly, In practice, current image 23 of Fig. 2 only shows approxintately a gravitational center 
position of sides of each pattern. 

so Fig. 3 is a front view showing the movement of optical system. In the same figure, 31 is one cell when the 

pick-up element is a sdid pick-up element such as CCD. For the convenience of explanation, it is assumed 
that the movement directbn of image coincides with a direction of array for one cell in the pick-up element 3. 
The pick-up element 3 converts a pattern of optical image thereon photoelectrically during a predetenmined 
period of exposure. 32 is an optical image at the start of exposure, and 33 is an optical image at the termination 

55 of exposure. The optical image 32 at the start of exposure is moved to the optical image 33 at the termination 
of exposure because the image moves during exposure as shown In Rg. 2. 

The movement vector 24 as shown in Fig. 3 Indicates the movement between the optical imag 32 at the 
start of xposure and the optical image 33 at the tenmination of exposure. This is almost the same as that of 
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Rg. 2. but more strictly, slightly drfferenL That is, the movement vector as shown In Rg. 2 one taken at nearly 
fritenmediate times of respective exposure periods for two images. On the contraiy, the movement vector as 
shown in Fig. 3 is one taken for an image of interest fr m th start of exposure to the tenminatk>n of exposure. 
Accordingly, when the amount of image movem nt changes abruptly, Ixjthnnov m ntv ctorswOlhavedlfrerent 
5 values. Generally, both of the values can be alnrK)st the same, but the movement vector 24 as shown in Rg. 3 
may be used after some slight con^ction when required in the parameter setting circuit 9, because the move- 
ment vector 24 obtained from the movement detection circuit 7 is one as shown in Fig. 2* 

Figs. 4A-4C are graphs showing the filter characteristics for the filtering useful in the filter 1 0 for correcting 
the degradatton of image. 

10 In Fig. 4A. 41 is a point image dlstritHition functton with the moven^t of image. The axis of abscissa x in 

the spatial coordinate system is taken atong the movement direction. The lenth of the movement vector 24 is 
assumed to be a. Then, the image generated by one point of object 1 moves during exposure period, approxim- 
ately following the point innage dtstrilsution functk>n 41. 
Representing that function as h(x), 
*5 h(x) = Rect(x/a) (1) 

42 in Fig. 4B is a frequency characteristic showing the degradation of image. 
Representing the frequency as f and the frequency characteristk: 42 as H(f), 

H(f) = (sinicaf)/icf (2) 
t>ecause H(f) is a Fourier transfonm of the point image distribution function h(x). 
20 43 in Fig. 4C is a frequency characteristic of filter, and representing it as P(f), 



P(f >=1/H(f ) 

25 =nf/(sinira£) (3) 

Such a filter is called as an inverse filter. 

That is, H(ff)-P(f)=1 , which means that the filtering of P(f) can compensate for the degradatton of image with 
H(f). 

30 In the filter 10 of Fig. 1, by filtering with this filter, the resolution of output video signal 13 is enhanced and 

excellent qualf^ of image can be obtained, l-lowever, the Inverse filter can be realized only approximately 
because it has infinite value at the frequency where the Fourier transform H(f) is zero. And the frequency range 
can t>e a range where the frequency spectrum exists. 

As dearly seen from Rgs, 4A-4C and expressions (2). (3), the characlerisUc of degradation H(f) and the 

35 characteristic of compensatton filter P(0 contain the size a of movement vector 24 as a p>arameter. The x-axis 
and f-axis are each taken along the direction of movement vector 24, which reveals that P(f) depends on the 
size and direction of movement vector 24. 

Accordingly, it is desirable that the fSter 10 has its filter changed adaptively depending on the movement 
vector 24. 

40 The filter 10 has two methods of performing the filtering processing. One of them is the filtering on the axis 

of frequency, in whfch the Fourier transfonm is taken of the image signal read out from the frame memory 6 
with FFT (Fast Fourier Transform), which is then multiplied by the inverse filter P{f), and the inverse Fourier 
transfonm is taken so that filtered Image signal is obtained. 

Another method is the fOtering on the axis of time, performed in such a way that the impulse response ts 
45 Obtained by the inverse Fourier transformation of inverse filter P(f), and convoluted to nmage signal from the 
frame memory 6 so that filtered output can be obtained. 

When the inverse filter is realized with the convolution in the axis of time, an impulse response S(x) of filter 
fin the following expression can be used. 

60 

S(x)=K6Mx) * IZ6 (x-{2k-l)a/2)sign{x)I ... (4) 

65 Where K is a proportional constant 6(x) is a delta function, and 6'(x) is a derivative of the delta ftjnctk)n. And 
"** is a symtK)! indicating the convolution, and sign(x} indicates a sign such that 
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Note that the expression (4) Is obtained by taking the Fourier transform of expression (3) using the delta 
10 function. 

Fig. 5 is a graph showing ttie tmpuise response of inverse filter. 

51 is an tmpuise response of the invade filter, representing the expression (4). 

The expression (4) must be truncated midway because It continues Infinitely In the direction of x-axis. 
Therefore, it is desirable to use thatfunction In the filtering processing after multiplication of the windowfunction 
IS such as a hamming window. 

In the inverse filter, the frequency area where the image information is almost lost with the degradation of 
bnage, i.e„ where the value of frequency characteristic 42 ts zero, and the high frequency area where there is 
only a few image information by nature may t>e given the characteristic of a large gain so that the output image 
has often a poor S/N ratio. Therefore, in the filter 10, the Wiener filter can be substituted. 
20 The frequency characteristic of the Wiener filter R(f) can be represented In the following expression. 

R(f,= H®lf) (5> 

|H(x) |"^+*a(f)V*s(f) 

25 

Where On(f) and indicate the power spectrum of noise and image signal, respectively, and© indicates 
the complex conjugate. 

Here, as it is difRcult to obtain <D„{f) and Oa(f) correctly, On(0 is set to be constant by assuming the white 
30 noise, and Ojf) Is set to be the Gaussian type. Or they can be predetennnined with the assumption that O„(f)/O«(f) 
constant over all frequencies. 
In the Wiener filter, at the frequency where the signal component is sufficiently larger than the noise com- 
ponent, the value is almost the same as that of inverse filter, or conversely, it is dose to zero at the frequency 
where the noise component is larger than the signal component. 
35 - Fig. 6 is a graph showing the frequency characteristic of Wiener filter. 61 is a frequency characteristic of 
Wienerfilter. Compared with the frequency characteristic 43 of inverse filter, it can be seen that the gain is smal- 
ler at the frequency area with the poor SN ratio. And in ttie Wiener filter, like the inverse filter, it Is desirable 
that the characteristic may be adaptively change depending on the movement vector 24. 

Various filter characterfetics of the filter 10 have generally the charactaistic of a high-pass filter or t>and- 
40 pass filter. 

Fig. 7 is a block diagram showing a second embodiment of the present invention. 

The second embodiment shows a device which is effective when there are moving area and stationary area 
in an image, and further when the moving area is separated into a plurality of regions which have different move- 
ment vectors. 

4$ 71 Is an output of the movement amount detection circuit 7, i.e.. the movement vector for each block or 
pixel wfthin a screen. 72 is an area disaiminalion circuit, 73 is its output, i.e., an address offset signal, 74 and 
75 are other outputs of the area discrimination circuit 72, i.e., the area signal and movement vector within area, 
respectively. 76 Is a switch for sending the input signal to either of two output lines. 77 is an output video signal 
being processed for each area. 

so The stages where the input Image signal Is converted from analog to digital form, stored into the frame menv 

ory 6, and transferred to the moverient amount detection circuit 7 are the same as in the firet embodiment 

The movement amount detection circuit 7 transfere the movement vector 71 to the area discrimination cir- 
cuit 72. 

The area discrimination circuit 72 divides the screen into tiie stationary area and a plurality of moving areas 
55 having dHferenl movement vectors, based on the movement vector 71 . The area discrimination circuit 72 selects 
adesired area of divided areas, and sends the movement vector of the selected area as an address offset signal 
73toth mem ry reading circuit 8. Th mem ly reading circuit 8 reads tfie Image signal from the frame memory 
6 by offeetting th address, bas d n the receiv d signal. Thereby, the entire screen is shift d. 
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The area discriminatton circuit 72 sends the area signal 74 and the movement vector 75 within area to the 
parameter setting circuit 9, and the parameter s tting circuit 9 sets th filter of different characteristic for each 
area to the filter 10. Th area signal 74 is also sent to the switch 76, which sends the image signal from the 
fram memory 76 to the D/A converter 1 1 for the stationary area or to the filter 10 for the moving area. The 
5 output of filter 1 0 is subsequently sent to the D/A converter 1 1 . That is, only for the moving area, the filtering 
processing is performed. 

Note that the switch 76 can be integrated Into the filter to by using a fflter which allows the transmission of 
whole frequency band, if the stationary area is considered as a special case in the fflter 10. 

The analog signal output of the D/A converter 1 1 has a synchronism s^nal added by the synchronism signal 
10 adding circuit 12, and sent out as the output video signal 77 being processed for each area. 
Fig. a is a plan view showing images containing a pluralrty of movements, 
in this figure, 81 ts an output screen which corresponds to a nronitor display screen. 
82 and 83 are first and second images of previous screen, respectively. 84 and 85 are first and second 
Images of current screen, respectively. 86 is a background image, composed of small squares arranged in Rg. 
13 6* 

In transferring from previous screen to current screen, the first and second images 82, 83 of previous screen 
are moved to the first and second images 84. 85 of current screen on the output screen 81, respectively. How^ 
ever, the moving directions and sizes of two images are different The background image 86 is not moved 
herein, Le., coincident between previous screen and current screen. 
20 Fig. 9 is a plan view showing the area discrimination result 

91 and 92 are first and second moving areas, respectively. 93 and 94 are the movement vectore within 
areas of the moving areas 91 , 92. 95 a stationary area. 

The area discrimination circuit 72 of Rg. 7 performs the area division and the calculation of movement vec- 
tor within area as shown in Fig. 9. That is, the first and second moving areas 91 . 92 and the slattonary area 95 
25 are dwided, and the movement vectors 93. 94 within areas are obtained for the first and second moving areas 
91,92. ^ 

When the device as shown in Fig. 7 is a tracking device, the tracking of specified image is performed. If it 
is assumed that the second image 83 is tracked in the current screen, the area discrimination circuit 72 sends 
the movement vector 94 within area of the second nraving area 92 to the memory reading circuit as an address 

30 offset signal 73. At this time, as a result of shifting of the image due to the offset applied in reading the knage 
signal from the frame memory 6, the second image 84 of current screen is displayed on the same place as the 
first ifnage 83 of previous screen on the output screen 81. The images of other areas are shifted. 

The switch 76 sends the image signal of the first and second moving areas 91 , 92 to the filter 1 0, and that 
of the stationary area 95 directiy to the D/A converter. 

35 The filler 1 0 has its filter set with different charactersistic by the parameter setting circuit 9, depending on 

the movement vectors 93, 94 within areas, for the images of the first and second nrtoving areas 91 , 92, in order 
to perform the filtering processing. The settings of filter and parameters used in the filter 10 are the same as 
in the first emtx>dtment 

As above described, the movement detection device of the present invention can compensate for the deg- 
40 radation of amage quality resulting from the movement of image with the filtering processing, so that there Is 
an effect of increasing the resolution of output image with the movement correction device, thereby providing 
a high quality image. 

Further, the filter characteristic useful for the filtering processing has such an effect that ttie Image quality 
is made excellent neariy optimal, by changing it adaptively t>ased on the movement vector to be obtained espe- 
45 dally for the noovement correction, and without Increasing the cost 

Next to accomplish the sbcth and seventii objects of the present invention, an embodiment In which the 
movement detection device is applied to a focus detection apparatus to improve the focus detection accuracy 
w9l be described. 

Recently, image equipments such as a video camera or electronic camera have been remarkably 
50 devetoped. and it Is requisite for its function to have an automatic focus adjustment device in tiie respect of 
operativtty. 

By the way, for the type of implementing the focus detection device, tiiere ajB provided a device of tfie pas- 
sive type in whksh the focusing signal is obtained by taking the correlation of image picked up by a twirvlens 
optical system, or an automatic focus adjustment device of the active type in which tiie focusing is judged from 
55 a position of spot generated by the reflected light flux by radiating ttie intrared light onto an object 

On tiie otiier hand, in th pick-up device such as a television camera for obtaining the image signal, a focus 
detectfon device has been developed in which ttie focus detection is performed by carrying out the Imag pro- 
cessbig of image signal, in such device using the image processing, th signal for detecting the focusing state 
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is obtained from th image signal, whereby there is a f ature that the focus detect! n is allowed inespective 
of the distance from an object, without special element or circurt for making the Infrared projection and with 
high precision, so that the development has been rapidly progressed. 

Figs. 1 6A-1 6B are views for explaining an embodiment of focus detection method with a conv ntional image 
5 processing, fllustrating the intensity distribution for the edge portion of an object image in the unfocused and 
focused states, In which Rg. 16A shows the unfocused state and Fig. 16B shows the focused state. 

In Rg. 16A, EO shows an intensity distribution of the edge portion for an object image in the unfocused 
state, with a vague distribution due to the unfocused condition and a large vridth of edge portion. 

Also, In Fig. 16B, El shows an intensity distribution of the edge portion for an object Image in the focusing 
10 state and at the same place as for the intensity distribution EO of unfocused edge portion. In the focusing state, 
it shows a nan^w and steeply rising up edge. 

Accordingly, the width of edge portion for object image is detected, and the focusing and unfocusing are 
Judged from Its edge width. That is, the focusing can be Judged by nrtaking use of the property of narrow edge 
width at the focusing. 

IS The edge intensity distribution EO in the unfocused state Is a dlstritnition of the edge portion detected from 

the image s^nal, where the edge with Is represented by the following expression. 

ft=di/(dli(x)/dx) (6) 

Where d-t indicates an Intensity difference of edge portion. It(x) is a fonction for representing the intensity dis- 
tribution of edge in the unfocused state, whereby dli(x)/dx indicates a slope of edge. This slope of edge can 
20 be used by taking the average of slopes of focusing in a range from a portion where edge rises up to a portion 
where it becomes flat again. 

Also, at the focusing, the width of edg e fx can be calculated from the Intensity distribution El for the focusing, 
using the following expression. 

^2 = d2/(dl2(x)/dx) (7) 

25 Where dj is an intensity difference of edge portion, \^x) is a function for representing the Intensity distribution 
El of edge at the focusing, and dl2(x)/dx is a slope of edge. 62 has almost the same value as di, and dl2(x)/dx 
is larger than dli(x)/dx. 

Accordingly, since £2 is a smaller value Uian ft* it can be seen that the edge width becomes smaller and 
the focusing has been adjusted. 
30 In this way, generally, a method In which the edge width is calculated from a density difference and a slope 

of edge portion, and the state is judged nearer to the focusing if the value is smaller is practiced as one method 
of making the focus detection with the Image processing. 

i-lowever, in the above-mentioned focus detection device, when an image has the movement i.e., when 
an object is moving, or when the whole screen has shifted as a result of trembling of hand and panning, the 
35 image becomes unfocused due to its movement, whereby there is a disadvantage that the width of edge is wide- 
ned due to the movement, and correct detection of focus can not be n^de. 

This embodiment has been made to resolve the abovennentioned problems, characterized by focus detec- 
tion apparatus comprising movement detectton means for detectirtg a movement of an image from the pick-up 
signal, movement correction means for correcting the movement of the image based on the output of the detec- 
40 tion means, and focus detection means for performing the focus detection by extracting a signal component 
varying with the focusing state from the pick-up signal having its movement component of image corrected by 
the movement correction nneans. 

Thereby, a high precision focus detection apparatus can be realized without decreasing its precision owing 
to the movement of image, in which the focus detection can be perfomned by detecting the movement of an 
45 image from an Image signal, and using the signal for which the degradation of resolution due to the movement 
of the image is compensated. 

A focus detection appartus of this example wOl be described in detail with reference to the drawings. 

Fig. 10 is a block diagram showing a third example in which a movement detection device of the present 
Invention is applied to the focus detection apparatus. 
so In the same figure, 101 is an object, 102 Is a pk^-up lens, and 103 is a pick-up element or pick-up tube 

such as CCD for outputting a pick-up signal by photoelectrically converting an object Image formed on a pick-up 
plane by the pick-up lens 2. 104 is an amplifier for amplifying the pick-up signal output from the pick*up element 
3 to a predetenmined level, 1 05 is an A/D converter for converting an input analog pick-up signal to the digital 
signal, 106 is a movement vector operation drcuit for obtaining the movement vector of image from the image 
55 signal which has been converted to the digital signal by the A/D converter 1 05, 1 07 Is an x-axIs projection circuit 
for projecting the movement vector on the x-axis that is a horizontal direction of screen, and 108 is an x com- 
p n nt fth m vement vector. 

1 09 is an edge detection circuit for detecting the width of edge portion for an object image, 1 1 0 is an dg 
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width detection circuit for detecting the width of dge portion detected by the edge detection circuit 9, and 111 
is an edge width signal. 

112 is a comparator, and 113 is a m mory. 114 is a lens control circuit, 115 is an fens control signal, and 
116 is a lens driving circuit for moving the pick-up lens 102 in a direction of optical axis to adjust the focus. 

5 On the other hand, 1 17 is a video signal processing circuit for outputting a standard television signal on 

television camera by performing the signal processing such as the gamma correction or various filtering to the 
pick-up signal output from the A/D converter 105. 118 is a 0/A converter for converting the digital sfgnat output 
by the video signal processing circuit 117 to the analog signal, and 1 19 is a synchronism signal adding circuit 
for adding a synchronism signal to the image signal output from the D/A converter 118. and 120 Is an output 

10 video signal. 

With the above constitution, the pick-up lens 102 forms an image of object 1 01 on the pick-up plane of ptek- 
up element 103. and the pick-up element 103 converts photoelectricalty the ixDage of object to output an Image 
signal. The image formed on the pk:k-up element 103 involves the movement owing to the movement of the 
pick-up lens 102* pick-up element 103 or object 101 . 
15 The image signal output from the pick-up element 1 03 is amplified by the amplifier 104. and converted to 

the digital signal by the A/D converter 105. 

A part of the digitized image s^nal is input into the movement vector operation circuit 1 06. The nrKivement 
vector operatk)n drcuit 106 contains a frame memory where image of previous frame is stored, and in which 
the movement vector of image is calculated by comparing the image of cunrentframe with that of prevkxjs frame 
20 stored in the frame memory. Exemplary of the method of operating the movement vector is that used in as a 
so-called representative point matching method or gradient method can be used. 

The X-axis projection circuit 1 07 gives an x-axis component signal 1 08 from the movement vector obtained 
t>y the movement vector operation circuit 106. 

The digitized image signal is sentto an edge portion detection cnt:uit 109. The edge portion detection circuit 
25 109 detects an edge portion from the informatton such as a slope for the image signal, and selects an edge 
having the largest slope with respect to the x-axis, for example, as the edge for Judgement of the focusing. The 
edge wklth operatton circuit 110 calculates the width of edge from a density difference of edge and a slope of 
edge, as above described, and output it as an edge width signal 111. The edge width signal 1 11 is subtracted 
frcm the x-axis component signal 108 of movement vector and then sent to the comparator 112. The signal 
30 sent to the comparator 1 1 2 is a n edge width sig nal with the movement of image conrected. And the comparator ; 
112 compares the Input corrected edge wkith signal with data within the memory 113. 

Within the memory 113, the conrected edge width signal in previous field or frame is stored. 
The comparator 112 sends a control signal to the lens control circuit, as well as writing a smaller edge wklth 
signal of two corrected edge width signals into the memory 113. 
35 The control signal is one in which driving of the current pick-up lens 102 is continued in the same direction 

wtten a newly input edge wkith signal is smaller than the previous edge width signal, or driving is performed In 
a reverse directksn when it is larter than the previous edge width signal. Also, It may be permitted to send a 
signal in which the amount of driving the lens is gradually changed depending on the amount of variation in 
the corrected edge signal. Or when the amount of variation is quite small, a control signal for stopping the 
40 amount of driving the lens can be sent by deciding the focusing state if the amount of variation is changed from 
negative to positive. In order to make tiie fine control, it is desirable tiiat the conrected edge signals as much 
as several frames should be stored In the memory 113. 

The lens control circuit 14 issues a lens driving signal 115, based on a control signal sent from the com- 
parator 112, in accordance with which tiie lens driving circuit 116 drives the pick-up lens 102. 
45 On the other hand, the digitized image signal is Input into the video signal processing circuit 1 17, tfien input 

into the D/A converter 118 for conversion into the analog signal, has a synchronism signal added in the 
synchronism signal adding circuit 119. and ou^ut as a vkJeo signal. 

Fig. 1 1 is a view showing schematically the movement of image, like in Rg. 2. 

In this figure, 121 is an output screen. For example, a monitor display screen can be assumed. Like in F^. 
so 2, 112 a previous image, and 123 is a current inr^ge. 124 is a noovement vector when the previous image 
122 moves to the current image 123. 125 is a projection vector of the movement vector 124 onto the x-axis. 
In the output screen 121, a video signal 120 of Fig. 10 Is displayed. 

For example, an ^age displayed witii trembling of hand or panning shows the movement from previous 
image 122 to current ^age 123 when time has passed from one dock to another even if tine object 101 is a 
55 Stationary object 

Accordingly, the movement vector 124 Is operated in the movement vector operation circuit 106, and the 
prc>{ectk>n vector 125 is calculated in the xsods projection circuit and output as an x-axis signal component 1 08. 
Here, as th current image 1 23 involves the movement, the value of each pbc t Is integrated in the direction 
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Of movement vector 1 24. Accordingly, In practice, cun- nt image 123 as shown in Fig. 1 1 only shows approxim- 
ately a gravitational center position of sides of each pattern. 

Fig. 12 is a front view showing th movement of optical system. In the same f^ure, 131 is one cell when 
the pick-up element Is a solid pick-up element such as CCD. 

5 For the convenience of explanation, it Is assumed that the movement direction f image coincides vnth the 

annay direction of one cell in the pick-up element 103. The pick-up element 103 converts a pattern of optical 
image thereon photoelectrically during a predetenmlned period of exposure. 132 is an optical image at the start 
of exposure, and 133 is an optical image at the termination of exposure. The optical image 132 at the start of 
exposure has been moved to the optical image 1 33 at the termination of exposure because Image moves during 

10 exposure like in Fig. 11. The movement vector 124 as shown in Fig. 12 indicates the nriovement between the 
optical Image 132 at the start of exposure and the optica! Image 133 at the termination of exposure. This is 
almost the same as in Rg. 1 1 , but more strictly, slightly different 

That is, the movement vector as shown in Fig. 1 1 is one taken at neariy intermediate times of respective 
exposure periods for two images. On the contrary, the movement vector as shown in Fig. 12 Is one taken for 

IS an image of interest from the start of exposure to the termination of exposure. 

Accordingly, when the amount of fimage movement changes abruptly, both the movement vectors may have 
different values. Generally, both values can be almost the same, but the movement vector 24 can be used after 
slight correction, because the movement vector 124 obtained from the movement vector operation circuit 106 
is as shown in Fig. 11. 

20 Ffe. 13 is a characteristic graph showing a point image distribution functfon with the movement of image. 

The fonn of function is the same as the example of Rg. 4. 141 is a point image distribution function. Here, it is 
assumed that the length of projection vector 1 25 is c. Then, the line generated by one point of object 1 02 moves 
during exposure period, approximately following the point image distribution function 141. Representing that 
function as h(x) which can bo represented as previously shown in the expressbn (1), 

25 h(x) = Rect(x/c) (8) 

The pick-up image becomes unfocused in accordance with the expression (1), due to its movement as well as 
the out-of-^ocus state. 

Fig. 14 is a characteristic graph showing the connection of edge vwdth. 

151 Is an Image signal of edge portion, with its intensity distribution being l(x). This corresponds to a signal 
so directly obtained from the pick-up element 1 03. 1 52 is an intensity distribuslon of edge portion when image does 
not contain any movement, its intensity distribution being l'(x). The dullness of the edge for r(x) can be deter- 
mined by the shape of an original object and the amount of out-of-focus. 

The image signal 151 for edge portion is an Image signal of portton selected in the edge portion detection 
circuit 1 09. The edge vridth operation circuit 110 operates the width of edge 1 from a densi^ difference of edge 
35 d and a slope dl(x)/dx, such that 

f = d/(dl(x)/dx) (9) 
However, 1 contains the amount of unfocus due to the movement of image. 
Between l(x) and r(x). tiie following relation stands. 

I(x) = l'(xrh(x) (10) 
40 Here, * represents the convolution operation. 

h(x) is a function of width c as shown in Fig. 1 3, in which l(x) has an edge slope portion widened by about 
c/2 to the right and left compared with l'(x), as shown in Rg. 14. Accordingly, assuming the width of edge for 
l'(x) as I', the following expression approximately stands. 

£ = f' + c (11) 

45 The width Of edge 1 directly obtained from the image signal 161 of edge portion contains the size c of pro- 

jection vector 125, thus having a larger value than originally obtained, and may vary In accordance with the 
movement of image. In the expression (1 1). by subtracting c from 2, it is clear that f ' can be obtained, and is 
not subject to the influence of the movement of image by judging the focusing based on f 

That Is, as shown In Fig. 10, by subtracting an x-axIs signal component 1 08 having the value of c firom an 

50 edge width signal 111 having the value of f, £' is obtained, and then input into the comparator for use as a 
signal forjudging the focusing, so that the detection of focusing can be made without influence of the nKivement 
of image. 

In tiie explanation given herein, by considering tiiat the intensity distribution of edge portion is obtained 
along the x-axis, the movement vector is also projected onto the x-axis. As the movement vector 24 is obtained 
55 In ttie form of representation witti x-axis and y-axis components, the processing for tiie x-axis projection is prac- 
tically unnecessary. But if tiie intensity distribution of edge portion is obtained in a horizontal axis. I.e.. otiner 
ttian x-axis, for example, in tiie steepest direction of edge portion of Interest, so as to operate the widUi of edge, 
til projecti n of movement vector necessary. The size of projection vector can be obtained in a simple man- 
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ner as a value of Inner product between a unit vector in its direction and the movement vector. 

F^. 15 IS a block diagram showing a fourth example of focus detection apparatus according to the present 
invention. 

In the same figure, 1 61 is a frame menrrory, and 1 62 is a fflter. 1 63 Is a parameter setting circuit for supplying 
5 parameters to the filter 162. 1 64 is an image signal fStered. 

In this example, the signal read from the pick-up element 103 is passed to the filtering processing based 
on the movement vector, to perfbnm the focus detectton from that s^nal. 

LBce in the third embodiment, the digitized Image signal is output from the AID converter 105. The frame 
memory 161 stores this signal temporarily. 
10 The digitized image signal is also sent to the movement vector operation drcuit 1 06, where the movement 
vector 124 is operated. The frame memory 161 ads as a delay element for synchronizing the image signal to 
tenminate the operation of movement vector 1 24. 

The signal read from the frame memory 161 is sent to the filter 162, where the filtering processing is per- 
Ibrmed. The frequency characteristic of filter 162 is set by the parameter setting drcuit 163, where the par- 
ts ameters are given to the filter 162 so as to correct unfocused Image due to the nrtovement from'the operation 
result of movement vector 124. 

The inwige signal 164 filtered is sent to the edge portton detection circuit 109, where like in the first embo- 
diment, the edge portion Is selected, and after that portion, the focusing judgment operation is performed to 
drive the pick-up lens 102. 

20 On the other hand, the image signal 1 64 filtered is sent to the vkJeo signal processing circuit 1 17, where 

like in the third embodiment, it is finally output as an output video signal 120. 
The prindple of this example will be described below. 

Let the size of nriovement vector 1 24 be a', and let the spatial coordinate atong the movement direction be 
x*. The point image distribution Unction h'(x) generated by the movement vector 24 is given by, in accordance 
25 with the previous expression (1). 

h'{x) = Rect(x'/a) (12) 
The degradation of image can t>e corrected by the filtering. 

The filter for the filtering can use the characteristic as shown In Figs. 4B and 4C in the first example. Exp- 
laining this using Rgs. 4B and 4C. 42 is a frequency characteristic showing the degradation of image with the 
30 movenr^nt, and can be represented by the previous expression (2). 

Accordingly, the frequency characteristic of inverse filter for compensating for the degradation of image as 
above described is as shown by 43 in Rg. 4C. That is, H(f).P(F)=1, in which the filtering with P(0 allows the 
compensatton for the degradation of image with H(0. 

By filtering with that filter in the filter 1 62 in Rg. 1 5, the resolution of output video signal 120 is increased, 
35 so that excellent image can be obtained. However, in this embodiment, the inverse filter can be achieved only 
approximately, because it becomes infinite at the frequency where H(f) is zero. The range of frequency can be 
a range where the frequency spectrum for image signal exists. 

As cleariy seen firom Figs. 4A and 4C, expresstons (2) and (3). the characteristic of degradation H(f) and 
the characteristic of compensation filter P(f) contain the size a of movement vector 24 as the parameter. The 
40 x'-axis and f-axis are taken along the direction of movement vector 124, respectively, and P(f) depends on the 
size and dsBCtion of movement vector 124. 

Accordingly, it is desirable that the filler 1 62 changes adaptively the filter in accordance with the nrravement 
vector 124. 

In order to perform the filtering processing in the filter 1 62, there are two methods like in the previous first 

49 emt>odiment One of them is the filtering on the axis of frequency, in which the Fourier transform is taken of 
the image signal road out from the flrame menrrary 161 with FFT (Fast Fourier Transform), which is then mul- 
tiplied by the inverse fflter P(f), and the inverse Fourier transfomn is taken, so that fHtered image slngal is 
obtained. 

Another method is the filtering on the axis of time, perfonned In such a way that the impulse response is 

50 otytained by the inverse Fourier transform of inverse filter P(f), and convoluted to image signal from the frame 
memory 6 so that filtered output can be obtained. 

As regards the constitution of filter and the filtering processing used herein, the inverse filter and Wiener 
filter can be used, as described using expresstons (10), (11) and Figs. 5, 6 in the previous first embodiment, 
and the explanation of analysis is omitted. With the filtering, the degradation of image, Le., the degradaion of 
55 resolution, can be compensated, so tiiat the excellent focus detection can be made. 

Also, in til filter 1 62, other various filters are used. As the frequency characteristic 43 has a characteristic 
of low-pass ^ter, the filter characteristic of filter 162 has g neraliy a characteristic of high-pass filter or band- 
pass filter. 
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As edge portion of edge signal 164 In the image signal 164 filtered is represented as a signal analogous 
to that as shown in F^. 14. That is. before filtering, it is like the image signal 1 51 of edge portion, but after fil- 
tering, it becomes the intensity distribution 152 when there is no movement of Image. 

Accordingly, by operating an edge signal width from the Image signal 164 filtered and using it for Judgment 
5 of the focusing, stable detection of focus can be perfbnmed without alnrrost any influence of image nriovement 
Also in this case, the value of edge width obtained is smaller than if the edge width is operated without taking 
into consideration the movement of image. 

Also, in this embodiment there Is a feature that the output video signal 120 itself can provide an excellent 
and high-quali^ image with high resolution. 
10 \A^en the whole screen does not move and an object Is moving, by dividing the area, portions having com- 

mon movements can be subjected to the processing based on the same movement vector. 

It is note thatfor the detection of image movement, the method of operating the bnage signal was described, 
but when the service condition of pick-up device is much subject to the vibration, and provkied with a vibration- 
proofing apparatus, the movement vector signal can be obtained from an angular sensor or acceleration sensor 
IS of vibration-proof apparatus. In this case, it is not simple to deal with the movement of object, but when the 
movement of whole screen is predominant due to the vibration, a desired movement vector can be obtained 
and the excellent focus detectk>n can t>e made. 

As above described, with the focus detection apparatus according to the present Invention, thefocus detec- 
tion can be perfbnmed by detecting a signal component varying with the focusing state from the pick-up signal, 
20 wherein nrKsvement correction means is provided for detecting and correcting the movement of Image,* and par- 
tlculariy, the focus detection is made based on a signal component having the movement corrected by said 
nK>vement detectton means, so that it is possible to prevent the degradation of accuracy In the focus detection 
means caused by the decrease of signal depending on the focusing state, such as the dullness at edge portion 
or the decrease of high frequency component due to the movement of Image, whereby a stable focus detection 
25 apparatus with high prectston can be provided at all times in which It is not subject to the influence of camera 
vibratton or the movement of object 



Claims 

30 

1- A movement detection device for detecting movement of an image and compensating for the moventent 
of the image, comprising: 

(A) movement detection means for detecting the movement of the Image; 

(B) correction means for correcting the movement of the image based on an output of said detection 
35 means; and 

(C) filter means for perfonmlng a filter processing compensating for degradation of resolution due to the 
movement of said image. 

2. A movement detecting device according to claim 1 . wherein a characteristic of said filter portion Is consti- 
40 tuted to be adaptively detenmined in accordance with the movement of said image. 

3w A movement detection device according to daim 2. wherein said filter means is an Inverse fflter having a 
frequency characteristic for correcting a frequency chara^eristlc of the movement of image. 

45 4. A movement detection device accoreiing to daim 2. wherein said filter means is a Wiener fOter. 

5. A movement detection device according to claim 2, wherein said movement detection means detects a 
movement vector of image from the pick-up signal. 

50 6. A movement detection device according to daim 5, wherein said movement detection means changes the 
filter characteristic adaptively in accordance with the movement vector detected. 

7. A movement detection device according to claim 1 . further comprising nvovement correction means for cor- 
recting ttie movement of the Intage based on the output of said movement detection means. 

65 

8. A movement detection device according to daim 7, wherein said movement correction means corrects the 
movement of the image by changing an image memory and an address for reading an imag from said 
image memory based on the amount and direction of image movement 
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9. A movement detection device according to claim 8. wherefn said filter means is provided on the output side 
of said image memory. 

10. A movement detection device comprising: 
s (A) Image pick-up means; 

(B) movement vector detection means for detecting a movement vector of an image anrrang said Image 
pick-up signal; 

(C) fSter means for filtering said image pick-up signal; and 

(D) correction means for correcting degradation of resolution caused by the movement of said image 
fo by changing a frequency characteristic of said filter means, based on the movement vector output by 

said movement vector detectton means. 

11. A movement detection device according to daim 10, wherein said filter means has the frequency charac- 
teristic for compensating for the frequency characteristic of the image movement 

15 

12- A movenr>ent detection device according to daim 11, wherein said filter nrteans is an inverse filter of inverse 
polarity to the frequency characteristic of said image movement 

13. A movement detection device according to danm 11. wherein said filter means is the Wiener filter. 

20 

14^ A movement detection device according to claim 1 0, further comprising an image memory and Image move- 
ment conBction means for offsetting the movement of image by changing a read address for reading an 
image from sakJ image memory in accordance with the movement vector of said image. 

25 15. A movement detection device comprising: 

(A) movement detection means for detecting movement of an Image within a screen; 

(B) nrkovement correction means for correcting the movement of the Image based on an output of said 
movement detection means; 

(C) filter means for perfonning a filter processing compensating for the degradation of resolution due 
30 to the nrwvement of said image, based on the output of said movement detection means; and 

(D) filter control means for controlling an operation of said filter means, based on a dedsion result that 
a moving area and a stationary area within the screen are decided based on the output of sakl movement 
detection means. 

35 16. A movement detectton device according to claim 15. wherein said filter control means operates said filter 
means in the moving area within the screen, based on the output of said movement detection means. 

17. A movenrtent detection device according to daim 16, wherein the characteristic of said filter portion is con- 
stituted to be adaptively determined in accordance with the movement of said image. 

40 

18. A movement detection device according to daim 15, wherein said filter means is an inverse filter having 
a frequency characteristic for con-ecting a frequency characteristic of the movement of image. 

19. A movement detection device according to claim 15, wherein said filter means is a Wiener filter. 

49 

20. A fbcus detectk)n apparatus for detecting the foci^ from an Image pick-up signal, comprising: 

(A) nrK>vement detection means for detecting movement of an innage from said image pick-up signal; 

(B) movement connection means for correcting the movement of said image based on the output of sakS 
movement detection means; and 

50 (C) focus detection means for performing focus detection by extracting a signal component varying with 

a focusing state from said image pick-up signal having a movenrtent component of an image corrected 
by sakl movement correction. means. 

21. A fbcus detection apparatus according to daim 20, wherein sakj fbcus detection means Judges focusing 
59 when the width of an edge portion is minimum by detecting information for the vndth of the edge portion of 

the image from sakl image pick-up signal. 

22. A focus detectx)n apparatus according to daim 20. wherein said movement detection means detects the 
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movement vector of image from safd imag pick-up signal. 

23. Afocus detectton apparatus according to claim 21 , further comprising focus adjustment means for adjusting 
the focusing stat of an Image pick-up lens based on an output of said focus detection means. 

24. Afocus adjustment device comprising: 

(A) Image pick-up means; 

(B) movement detectton means for detecting nrtovementof an image from said Image pick-up signal out- 
put from said image pick-up means; 

(C) fQter nneans for performing a fOtering processing compensating for degradation of resolution due to 
the movement of said innage; and 

(D) focus detection means for perfomning focus detection based on the Image pick-up signal compen- 
sated by said filter means. 

25. A focus adjustment device according to dalm 24, further comprising filter control means for changing a 
characteristic of filter means, based on an output of said movement detectton means. 

26. A focus adjustment device according to daim 24, wherein said focus detection means detects the focus 
by detecting Information for the width of an edge for an image from said image pick-up signal. 

27. Afocus adjustment device according to claim 24, wherein said filter means has a frequency characteristic 
of reverse polarity to a frequency characteristic of said image movement 

2& A focus adjustment device according to daim 25, wherein said focus detection means detects the focus 
by detecting infomnation for the width of an edge for an image from said image pick-up signal. 

29. An intage processing method or apparatus in which a received image is processed to compensate for move- 
ment of it and is also processed to increase its resolution. 

30. An image processing method or apparatus for processing an image receh^ed in image fields, In which the 
receh/ed image is processed to compensate for movement of the image from field to field and also pro- 
cessed to compensata'for movement of the image during a field period. 

31. An image processing method or apparatus In which a received image is processed to compensate for move- 
ment of it or to determine movement amount information, and an auto-focus operation is cam'ed out taking 
into account the result of the said processing. 
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